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(54) Camera control system 

(57) In order to carry out display control of an oper- 
ating panel and realize an orderly display of an image 
picked up by a camera which is being controlled, an 
empty area In which an image picked up by one or more 
cameras is not displayed is searched for on a display 



screen, and a new picked-up image obtained from the 
one or more cameras is displayed in the empty area 
found. 
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BACKGROUND OF THE INVENTION 

Field of the Invention s 

The present invention relates to a camera control 
system suitable for use with surveillance cameras, 
video conference systems or the like which perform 
communication of information, for exanple, via a net* 
work. 

Description of Related Art 

In recent years, with the spread of personal com- 
puters (hereinafter called PCs) and a further improve- 
ment in the performance of communication between 
computers which is represented by the spread of Ether- 
net (trademark), video conference systems, surveil- 
lance systems or the like are increasingly becoming 20 
realized comparatively inexpensively by connecting 
control terminals such as general-purpose PCs to a net- 
work such as the Internet. 

For example, If a user transmits a control signal for 
a camera from a control terminal which is being used by 2$ 
the user, the control signal is received by the camera via 
a network and the camera is controlled in accordance 
with the control signal. A video signal obtained from the 
camera is received by the control terminal via the net- 
work and a picked-up image is displayed on the display zo 
screen of a CRT or the like. 

During this time, control of the camera is executed 
in such a way that an operating panel provided with 
operating buttons is displayed on the display screen of 
the CRT or the like through a GUI (Graphical User Inter- 3S 
face) and the user moves a cursor on the display screen 
with a mouse and clicks on a predetermined one of the 
operating buttons. 

However, if an image obtained from one or more 
cameras is displayed on the display screen or a dis- 40 
played Image is magnified, a number of problems will 
occur. For example, the operating panel for camera con- 
trol overlaps a picked-up image of a camera to be con- 
trolled by the user and the picked-up image is hidden In 
whole or part by tiie operating panel, or the camera 45 
becomes difficult to operate. 

BRIEF SUMMARY OF THE INVENTION 

It is. tiierefore, an object of the present invention to so 
carry out display control of an operating panel and real- 
ize an orderly display of an image picked up by a cam- 
era which is being controlled. 

To achieve the above-described object, In accord- 
ance with one embodiment of the present invention, 55 
there is provided a camera control system capable of 
displaying on display means a picked-up Image 
obtained from one or more cameras, which system 



comprises selecting mei^pbr selecting at least one 
image obtained from tiie one or more cameras, for dis- 
playing purpose, display processing means for display- 
ing an image selected by the selecting means, on the 
display means in a predetermined size, searching 
means for searching for an empty area on the display 
means, other than a display area occupied by tiie image 
displayed by the display processing means, and control 
means for causing a new Image obtained from the one 
or more cameras to be displayed in tfie empty area 
found by the searching means, if the new image is addi- 
tionally selected by the selecting means for displaying 
purpose. 

In accordance with another aspect of the present 
invention, there is provided a camera control system 
capable of displaying on display means a picked-up 
image ok>tained from one or more cameras, which sys- 
tem comprises selecting means for selecting at least 
one image obtained from the one or more cameras, for 
displaying purpose, display processing means for dis- 
playing an image selected by the selecting means, on 
tiie display means In a predetermined size, an interface 
displayed on the display means in a predetermined size, 
for selectively operating the one or more cameras, 
searching means for searching for an empty area on the 
display means, other than a display area occupied by 
the image displayed by the display processing means, 
and control means for causing the interface to be dis- 
played in the empty area found by the searching means. 

In accordance with anotiier aspect of the present 
invention, there is provided a control method for a cam- 
era control system capable of displaying a picked-up 
image obtained from one or more cameras, on a display 
screen of a display device, which method comprises a 
selecting step of selecting at least one image obtained 
from the one or more cameras, for displaying purpose, 
a display processing step of displaying an image 
selected by tiie selecting step, on the display screen in 
a predetermined size, a searching step of searching for 
an empty area on the display screen, otiier than a dis- 
play area occupied by the image displayed by the dis- 
play processing step, and a control step of causing a 
new image obtained from the one or more cameras to 
be displayed in the enpty area found by the searching 
step, if tiie new image is additionally selected by the 
selecting step for displaying purpose. 

In accordance with another aspect of the present 
invention, there is provided a control method for a cam- 
era control system capable of displaying a picked-up 
image obtained from one or more cameras, on a display 
screen of a display device, which method comprises a 
selecting step of selecting at least one image obtained 
from the one or more cameras, for displaying purpose, 
a display processing step of displaying an image 
selected by the selecting step, on the display screen in 
a predetermined size, an interface displaying step of 
displaying an interface for selectively operating the one 
or more cameras, on the display screen in a predeter- 
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mined size, a searching step of ^HPching for an empty 
area on the display screen, other than a display area 
occupied by the image displayed by the display 
processing step, and a control step of causing the inter- 
face to be displayed in the empty area found by the 5 
searching step. 

In accordance with another aspect of the present 
invention, there is provided a storage medium which 
stores a program for executing processing for a camera 
control system capable of displaying a picked-up image 10 
obtained from one or more cameras, on a display 
screen of a display device, the storage medium allowing 
the camera control system to execute the following 
processing: selecting at least one image obtained from 
the one or more cameras, for displaying purpose, dis- is 
playing the image selected, on the display screen in a 
predetermined size, searching for an empty area other 
than a display area occupied by the image displayed on 
the display screen, and causing a new image obtained 
from the one or more cameras to be displayed in the 20 
empty area found, if the new image is additionally 
selected for displaying purpose. 

In accordance with another aspect of the present 
invention, there is provided a storage medium which 
stores a program for executing processing for a camera 2s 
control system capable of displaying a picked-up image 
obtained from one or more cameras, on a display 
screen of a display device, the storage medium allowing 
the camera control system to execute the following 
processing: selecting at least one image obtained from 30 
the one or more cameras, for displaying purpose, dis- 
playing the image selected, on the display screen in a 
predetermined size, displaying an interfeice for selec- 
tively operating the one or more cameras, in a predeter- 
mined size, searching for an empty area other than a 35 
display area occupied by the image displayed on the 
display screen, and displaying the interface in the empty 
area found. 

The above and other objects, features and advan- 
tages of the present invention will become apparent 40 
from the following detailed description of a preferred 
embodiment of the present Invention, taken in conjunc- 
tion with the accompanying drawings. 




BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF 
THE DRAWING 



45 



Fig. 1 is a conceptual diagram of a camera control 
system according to an embodiment of the present 
invention: so 
Fig. 2 is a block diagram of the construction of a 
control terminal according to the embodiment of the 
present invention; 

Fig. 3 is a block diagram of the entire camera con- 
trol system according to the embodiment of the 55 
present invention: 

Fig. 4 is a view showing a display example on a dis- 
play screen according to the embodiment of the 



present invention 
Fig. 5 is a flowchart of the processing of display 
control executed by a CPU according to the embod- 
iment of the present invention: 
Fig. 6 is a view showing another display example on 
the display screen according to the embodiment of 
the present invention; 

Rg. 7 is a view showing one example of an area list 
according to the embodiment of the present inven- 
tion; 

Rg. 8 is a view showing another display example on 
the display screen according to the embodiment of 
the present invention; 

Rg. 9 is a flowchart of the processing of display 
control executed by the CPU according to the 
embodiment of the present invention; 
Rg. 10 is a view showing another display example 
on the display screen according to the embodiment 
of the present invention; 

Fig. 11 is a view showing another display example 
on the display screen according to the embodiment 
of the present invention; and 
Fig. 12 is a view showing another display example 
on the display screen according to the embodiment 
of the present invention. 

DETAILED DESCRIPTION OF THE INVENTION 

A preferred embodiment of the present invention 
will be described below in detail with reference to the 
accompanying drawings. 

Fig. 1 is a conceptual diagram showing a camera 
control system according to the prefen'ed embodiment 
of the present invention. 

The camera control system according to the pre- 
ferred embodiment is connected to a network 901 such 
as a LAN, a WAN or the Internet. As will be described 
below in detail, the camera control system is connected 
to the Internet. 

Client-side apparatus 300, 300a. 300b and 300c 
are situated at remote locations and output camera con- 
trol commands therefrom. Cameras 101 can be control- 
led from outside for panning, tilting or zooming, and are 
respectively connected to camera servers 100, 100a, 
100b and 100c. The cameras 101 connected to the 
camera servers 1 00. 1 00a, 100b and 1 00c are operated 
in accordance with a control command sent from a cli- 
ent-side apparatus having a cameral control right, and 
signals of input images inputted from the cameras 101 
are transmitted to the client-side apparatus. 

In the present embodiment, as shown in Fig. 1 . a 
plurality of camera servers and a plurality of client-side 
apparatus may be individually connected to the network 
901 , or a plurality of units in each of which a camera 
server and a client-side apparatus are integrated may 
be connected to the network 901. Such units each 
including a camera server and a client-side apparatus 
are capable of effecting mutual communication which 
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enables a camera situated on one^SIVlo be operated 
on another side via the network 901 . 

In accordance with the canfiera control system 
according to the present embodiment, an infinite 
number of camera servers and client-side apparatus of s 
the above-described types may be connected to each 
other via the network However, the present embodi- 
ment can also be accomplished in such a way that one 
camera server and one client-side apparatus are con- 
nected to each other via the network. 10 

In the camera server 100, a communication inter- 
face 902 transmits and receives signals to and from 
each of the camera servers and the client-side appara- 
tus via the network 901. A command interpreting circuit 
903 interprets a received signal and transmits a prede- is 
termined operation signal to the camera 101 connected 
to the camera server 100. An image input drcuit 904 
receives an input image from the camera 101 and per- 
forms signal processing on the image. A camera control 
circuit 905 is provided for controlling a panning, tilting or 20 
zooming operation of the camera 101 . 

In the client-side apparatus 300, a display control 
part 907 displays an image received from a camera 
server which is being accessed, or the state of control of 
the camera 101 connected to the camera server. An 25 
operation input part 908 requests a camera control right 
from the camera server which is being accessed, or 
instructs the camera 101 to alter the state of panning, 
tilting or the like, or inputs set values of camera param- 
eters. 30 

Incidentally, in such camera control system, one or 
more cameras may be connected to the camera sen/er 
100. 

In the following description, for the sake of simplic- 
ity, it is assumed that control terminals in each of which 35 
a camera server and a client-side apparatus are inte- 
grated are connected to a network. 

Fig. 2 is a detailed explanatory block diagram of the 
construction of a control terminal which corresponds to 
the aforesaid camera server and client-side apparatus. 40 
In the construction of a control terminal 20 which is 
shown in Fig. 2, a CPU 1 secures a work area by down- 
loading into a RAM 14 either of an OS (operating sys- 
tem) 4 and a camera control program 5 which are stored 
in a secondary storage 3, and collectively controls the 45 
entire control terminal 20 or transmits a control com- 
mand to a camera 12 via a network 13. 

The secondary storage 3 stores the OS 4, the cam- 
era control program 5 and the like, and is a magneto- 
optical disk (MO), a compact disc (CD-ROM), a hard so 
disk, a floppy disk or the like. 

The OS 4 is basic software for processing the oper- 
ation of the control terminal 20, and the camera control 
program 5 Is software for generating a camera control 
signal for panning, tilting, zooming or the like of the cam- ss 
era 12, and for performing A/D or D/A conversion of an 
image signal or applying predetermined processing 
such as compression or expansion to an image signal. 



The camera control progH^ performs management 
of an image display area and a display area for a cam- 
era control GUI 21 (to be described later) in a display 
part 7. or performs display processing such as "Move", 
"Deform" and "Scale". 

An input part 6 is provided with a keyboard and a 
pointing device such as a mouse, and plays the role of 
allowing a user to input a control command for the cam- 
era 12 through the camera control GUI 21 shown in Fig. 
4. The display part 7 includes a display device which is 
a bit-map display, a CRT or an LCD, and displays a 
picked-up image or the camera control GUI 21 for oper- 
ating the camera 12 via the network 13. 

The panning, tilting or zooming operation of the 
camera 12 can be continuously controlled, and an 
image processing device 9 performs A/D conversion of 
an image signal sent from the camera 12 or another ter- 
minal and image processing such as compression or 
expansion of an image signal, and displays the obtained 
image on the display part 7 or at another control termi- 
nal 20 via the network 13. 

A camera l/F 10 transmits a camera control signal 
to the camera 12, A network I/F 1 1 performs communi- 
cation with another control terminal 20 connected to the 
network 1 3, via the network 1 3. At this time, the network 
l/F 1 1 performs processing corresponding to the kind of 
network (such as Ethernet or ATM). 

As described previously, if the CPU 1 is to execute 
various kinds of control, the RAM 14 provides a work 
area to the CPU 1 when the CPU 1 downloads the OS 
4 stored in the secondary storage 3 into the RAM 14. A 
ROM 15 is a storage medium which stores various pro- 
grams similarly to the secondary storage 3. 

The above-described constituent elements of the 
control terminal 20 are connected to one another via an 
internal bath 8 so as to transmit and receive signals to 
and from one another. 

Rg. 3 is a block diagram of the entire camera con- 
trol system in the present embodiment. In Fig. 3, each of 
control terminals 20a, 20b, 20c and 20d has a construc- 
tion similar to the control terminal 20 shown in Fig. 2, 
and each of the control terminals 20a. 20b. 20c and 20d 
can transmit a signal such as an image signal and a 
camera control signal to any other control terminal via 
the network 13. Incidentally, although the present 
embodiment is provided with four control terminals 20 
for the sake of simplicity of description, the number of 
control terminals is not limited to four. 

Rg. 4 is a view showing a display example on the 
screen of the display part 7 of the present embodiment. 
In Fig. 4, reference numeral 18 denotes a display 
screen of the display part 7, and images picked up by 
cameras connected to the control terminals 20a and 
20b are respectively displayed in display areas 19a and 
19b. In the example shown in Fig. 4, since images 
picked up by cameras connected to the control termi- 
nals 20c and 20d are not selected for display on the dis- 
play screen 18, neither of them is displayed on the 
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display screen 18. 

The camera control GUI (operating panel) 21 is 
used for selecting a control terminal to which a camera 
to be controlled is connected, and controlling a field of 
view for image pickup and an image pickup magnifica- s 
tion of the camera connected to the control terminal 
selected. In the camera control GUI 21, buttons 22a, 
22b. 22c and 22d are used for specifying whether to dis- 
play on the display saeen 18 images picked up by the 
respective cameras connected to the control terminals io 
20a, 20b, 20c and 20d, or Ibr specifying which of the 
cameras connected to the respective control terminals 
is to be controlled. 

An image to be displayed on the display saeen 18 
is selected in such a way that a user moves a cursor 40 is 
with a mouse (not shown) provided in the input part 6 
and clicks on one of the buttons 22a, 22b. 22c and 22d 
which corresponds to the one of the control terminals 
20a. 20b, 20c and 20d to which is connected a camera 
which is picking up the image desired to be displayed. In 20 
the example shown in Fig. 4, the button 22a is clicked on 
and changed in color, and the image picked up by the 
camera 12 connected to the control terminal 20a is dis- 
played in the display area 19a. 

If the user desires to acquire a control right for any 25 
one of the cameras 12 connected to the respective con- 
trol terminals 20a, 20b, 20c and 20d, the user double 
clicks on the one of the buttons 22a, 22b, 22c and 22d 
that corresponds to an image displayed by tiie above- 
described operation. Then, the CPU 1 issues a control 30 
right acquisition request and requests a control right 
from a control terminal to which the desired camera is 
connected. Fig. 4 shows that the camera 12 connected 
to the control terminal 20b is in its controllable state, and 
the button 22b Is displayed with its color changed to a 35 
further exXenX and a thick frame which indicates that the 
camera 12 connected to the control terminal 20b is in 
the controllable state is displayed In the display area 
19b In which the Image picked up by that camera 12 is 
displayed. 40 

Buttons 28, 29, 30 and 31 are respectively used for 
instructing the controllable camera 12 to move its atti- 
tude upward, downward, leftward and rightward. But- 
tons 26 and 27 are respectively used for varying the 
image pickup magnification of the controllable camera 4S 
12 toward its telephoto end and Its wide-angle end. 

In the present embodiment, the picked-up images 
from the cameras connected to the network are dis- 
played on the display screen 18 shown In Fig. 4, without 
overlapping each other, and the camera control GUI 21 so 
is reduced in scale and moved to and located at a posi- 
tion at which the camera control GUI 21 interferes with 
as few of the picked-up images as possible. 

The processing of display control to be exerted on 
the display screen 18 by the CPU 1 will be described ss 
below with reference to the flowchart shown in Fig. 5. In 
the following description, It is assumed that tiie user 
operates an arbitrary one of tiie control terminals 20a to 




20d. 

As shown in Fig. 6, by way of example, it is 
assumed that the camera control GUI 21 and the dis- 
play area 19b occupied by the Image picked up by tiie 
camera 12 controlled by the camera control GUI 21 are 
displayed on the display screen 18. The camera control 
GUI 21 and the display area 19b can be moved within 
the display screen 18 if the user performs a dragging 
operation to move the cursor 40 with the mouse (not 
shown). 

During tiie state shown in Fig. 6. If the user desires 
to newly display on the display screen 18 an image 
picked up by one or more cameras connected to the 
control terminals 20a, 20b, 20c and 20d, for example, 
the camera 12 connected to the control terminal 20a. 
the user first clicks on the button 22a on the camera* 
control GUI 21 (S101). When the CPU 1 detects tiie 
clicking of the button 22a, tiie CPU 1 requests the con- 
trol terminal 20a to transmit Image data picked up by tiie 
camera 12 connected to the same, and acquires tiie 
image data (SI 02). 

In addition, the CPU 1 searches in an area list to 
determine whether an empty area in which to display 
the image data acquired from the control terminal 20a Is 
present on the display saeen 18. 

The area list is stored in tiie RAM 14 in the form 
shown in Fig. 7 by way of example, and includes the fol- 
lowing items: the coordinate values of the upper left 
point and the lower right point of a maximum area of tiie 
display screen, the coordinate values of tiie upper left 
point and the lower right point of the title of a picked-up 
image being currentiy displayed (tiie name of the control 
terminal to which the camera is connected), and tiie 
coordinate values of the upper left point and the lower 
right point of the camera control GUI 21 , as well as data 
indicating whether tiie control terminal to which tiie 
camera picking up the image Is connected is a target for 
camera control. If one of the display areas 19a and 19b 
and display areas 19c and 19d or the camera control 
GUI 21 is moved by the operation of the user, the CPU 
1 recognizes a position which has been reached by tiie 
one moved by the user, and rewrites the area list stored 
in the RAM 14. 

In area search, a maximum rectangular area on tiie 
display screen 18 is searched for, otiier tiian an image 
(Indicated at 19b In Rg. 6) from a control terminal which 
Is currently displayed on the display screen 18 (S103). 

Then, the CPU 1 determines whether tiie maximum 
rectangular area is sufficiently large to display a new 
image (S104). If there Is no sufficient empty area, tiie 
CPU 1 moves the display position of the currently dis- 
played image and relocate all areas displayed on tiie 
display screen 1 8 (SI 05), and updates the values of tiie 
area list stored in tiie RAM 14 with the values obtained 
from such relocation (SI 06). The process returns to 
Step S103, in which area search is again performed. 

If it is determined In Step SI 04 tiiat there is an 
empty area sufficient to display a new picked-up image. 
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the CPU 1 displays the image at an's|PRpriate position 
in the empty area (SI 07). Furthermore, the CPU 1 
enters the position at which the image is displayed into 
the area list (S1 08). 

In this manner, in the processing of displaying the 5 
image picked up by the camera 12 connected to the 
control terminal 20a during the state shown in Fig, 6, the 
display area 19b occupied by the image picked up by 
the camera 12 connected to the control terminal 20b is 
moved for relocation within the display screen 18. and io 
the display area 19a Is set in the resultant empty area 
and the image picked up by the camera 1 2 connected to 
the control terminal 20a is displayed in the display area 
19a so that all the picked-up images are displayed with- 
out overlapping each other, as shown in Fig. 4. is 

The above description has referred to a case where 
the camera control GUI 21 does not overlap a pIcked-up 
image. However, as the number of picked-up images 
increases further as shown in Fig. 8, it becomes neces- 
sary to execute the processing of relocating the camera 20 
control GUI 21 so as not to overlap any of the picked-up 
images. Fig. 9 shows an operational flowchart showing 
such processing. 

By way of example, in the following description, ref- 
erence will be made to the processing of further display- 25 
ing an image picked up by the camera 12 connected to 
the control terminal 20c. on the display screen 18 when 
it is in the state shown in Fig. 4. 

In the flowchart shown in Fig. 9, the processing of 
Steps S201 to S208 is similar to that of Step SI 01 to so 
SI 08 of Fig. 5, and the description thereof is omitted. 

As shown in Fig. 8. a newly displayed picked-up 
Image (displayed in the display area 19c in Fig. 8) will 
occasionally overlap the camera control GUI 21. The 
CPU 1 again makes a search in the area list and checks 35 
whether the camera control GUI 21 overlaps the display 
area occupied by the new picked-up image (S209). If 
the camera control GUI 21 does not overlap the display 
area occupied by the new picked-up image, the process 
is brought to an end, 40 

If the camera control GUI 21 overlaps the display 
area occupied by the new picked-up image, the CPU 1 
searches for an empty area into which to move the cam- 
era control GUI 21 , in the area list (S210). In the case of 
Fig. 8, a rectangular frame 52 shown by dashed lines 4S 
coH'esponds to such empty area. (The rectangular 
frame 52 actually is not displayed on the display part 7.) 
If there is such empty area, the CPU 1 moves the cam- 
era control GUI 21 into the empty area (in this case, the 
rectangular frame 52), as shown in Fig. 10 (S212). In so 
this manner, the picked-up image can be displayed with- 
out interfering with the camera control GUI 21 . 

There is another case where no empty area is 
present in the display screen 1 8. For example, as shown 
in Fig. 1 1 , if a picked-up image is displayed in the dis- ss 
play area 19d for the control terminal 20d, In addition to 
the picked-up images displayed in the display areas 
19a. 19b and 19c. nearly the whole of the display 




screen 18 will be occupilQpthe image display areas. 

In this example, the CPU 1 moves the camera con- 
trol GUI 21 onto a display area in which the image 
picked up by the camera 12 connected to a control ter- 
minal for which the user does not have a control right is 
displayed. For example, since the camera 12 connected 
to the control terminal 20b is in a selected state, the 
CPU 1 moves the camera control GUI 21 onto a display 
area other than the display area 20b, for example, the 
display area 19a in which the image picked up by the 
camera 12 connected to the control terminal 20a is dis- 
played, as shown in Fig. 1 1 (S213). 

Then, after the completion of the movement of the 
camera control GUI 21 , the CPU 1 updates the area list 
on the basis of new data (S214). In this manner, if the 
display areas which display different picked-up images 
occupy nearly the whole of the display screen 18. the 
CPU 1 controls the position of the camera control GUI 
21 to prevent it from overlapping the image picked up by 
the camera 12 which can be controlled by the user, 
whereby the user can view the image picked up by oper- 
ating that camera 12. 

However, if the display screen 18 is in the state 
shown in Fig. 1 1 , the user will not be able to view all the 
picked-up Images. For this reason, in the processing 
operation of Step S214. the CPU 1 may also display the 
camera control GUI 21 on a reduced scale so that the 
user can view the picked-up image overlapped by the 
camera control GUI 21 , with the camera control GUI 21 
interfering with none of the picked-up images as shown 
In Fig. 12. 

If there is an empty area but there is no area suffi- 
cient to normally display the camera control GUI 21 , the 
camera control GUI 21 may be reduced in scale so as to 
be accommodated Into an area into which to move the 
camera control GUI 21. The reduction in scale of the 
camera control GUI 21 can be realized, as by reducing 
the space between buttons or eliminating a blank space. 

As Is apparent from the foregoing description, In 
accordance with the present embodiment, picked-up 
images transmitted from the network are automatically 
displayed on the display screen without overlapping 
each other, and furthermore, the camera control GUI 21 
is automatically moved into an empty area or displayed 
on a reduced scale so that the camera control GUI 21 is 
prevented from interfering with the picked-up Images. 
Accordingly, the user can perform rapid camera control 
and can also view the picked-up images displayed on 
the display screen. 

Incidentally, it Is also possible to achieve the 
present invention by supplying a system or an appara- 
tus with a storage medium on which the program code 
of software for realizing the function of the above- 
described embodiment is recorded, and causing a com- 
puter (a CPU or an MPU) of the system or the apparatus 
to read out and execute the program code stored in the 
storage medium. 

In this case, the program code itself read out from 
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the storage medium realizes thelBKtion of the above- 
described embodiment, and the storage medium which 
stores the program code constitutes part of the present 
Invention. 

The storage medium for supplying such program s 
code may make use of, for example, floppy disk, hard 
disk, optical disk, magneto-optical disk. CD-ROM, CD- 
R, magnetic tape, nonvolatile memory card, ROM or the 
like. 

Although the function of the above-described io 
embodiment can be realized by a computer which reads 
and executes a program code, the function of the 
above-described embodiment may also be realized by 
an OS (operating system) running on the computer, In 
such a way that the OS performs actual processing in is 
whole or part on the basis of an instruction of the pro- 
gram code. 

In addition, the function of the above-described 
embodiment may be realized in such a way that a pro- 
gram code read out from the storage medium Is written so 
into either a memory provided in an expansion board 
inserted in the computer or a memory provided in an 
expansion unit connected to the computer and a CPU 
provided on the expansion board or the expansion unit 
performs actual process in whole or part on an Instruc- 25 
tion of the program code. 

If the present invention is applied to the storage 
medium, program codes con-esponding to the flowchart 
described previously are stored in the storage medium. 
In brief, modules essential to the camera control system 30 
according to the present invention are stored in the stor- 
age medium. 

In the present invention, it suffices to store the pro- 
gram codes of at least three modules in the storage 
medium. The modules include a searching module for 35 
searching for an empty area in the display screen, a 
moving module for moving a picked-up Image and a 
camera control GUI on the display screen according to 
an empty area found on the basis of a search result of 
the searching module, and a reducing mode for reduc- 40 
ing in scale the camera control GUI. 

As is apparent from the foregoing description, in 
accordance with the present embodiment, in an appara- 
tus capable of selectively controlling one or more 
remote cameras which are connected to each other, for 45 
example, via a networK an image from such one or 
more cameras and a camera control interface are dis- 
played on a display screen without overlapping each 
other, and if there is no sufficient empty area in the dis- 
play screen, the camera control Interface is displayed on so 
a reduced scale without interfering with images from the 
cameras. Accordingly, even if the number of images dis- 
played on the display screen is large, a user can view all 
of the displayed Images and perform rapid camera con- 
trol. 55 

In order to carry out display control of an operating 
panel and realize an orderly display of an Image picked 
up by a camera which is being controlled, an empty 
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area in which an imaK^cked up by one or more cam- 
eras is not displayed is searched for on a display 
screen, and a new picked-up image obtained from the 
one or more cameras is displayed in the empty area 
found. 

Claims 

1. A camera control system capable of displaying on 
display means a picked-up Image obtained from 
one or more cameras, comprising: 

selecting means for selecting a camera of the 
one or nrtore cameras; 

display processing means for displaying an 
image obtained from the camera selected by 
said selecting means, on the display means in 
a predetermined size; 

searching means for searching for an empty 
area on the display means, other than a display 
area occupied by the image previously dis- 
played by said display processing means; and 
control means for causing a new image 
obtained from the camera to be displayed in the 
empty area found by said searching means, if 
the new Image is additionally displayed by said 
display processing means. 

2. A camera control system according to claim 1 , fur- 
ther comprising an interface displayed on the dis- 
play means in a predetermined size, for selectively 
operating the one or more cameras, wherein said 
searching means searches for an empty area on 
said display means, other than both the display 
area occupied by the image displayed by said dis- 
play processing means and a display area occupied 
by said interfece. 

3. A camera control system according to claim 1, 
wherein if the empty area found by said searching 
means does not satisfy a predetermined condition, 
said control means relocates the display area occu- 
pied by the image displayed on the display means. 

4. A camera control system according to claim 1 , fur- 
ther comprising an interface displayed on the dis- 
play means In a predetermined size, for selectively 
operating the one or more cameras, wherein if the 
empty area found by said searching means does 
not satisfy a predetermined condition, said control 
means reduces said interface In scale and causes 
said Interface to be displayed on the display means 
on a reduced scale. 

5. A camera control system according to claim 1 , fur- 
ther comprising an interface displayed on the dis- 
play means in a predetermined size, for selectively 
operating the one or more cameras, wherein said 
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control means causes said intennPfo be displayed 
without overlapping a display area occupied by an 
image picked up by a camera controlled by said 
interface. 

5 

A camera control system capable of displaying on 
display means a picked-up image obtained from 
one or more cameras, comprising: 

selecting means for selecting a camera of the 10 
one or more cameras; 

display processing means for displaying an 
image obtained from the camera selected by 
said selecting means, on the display means in 
a predetermined size; is 
an interface displayed on the display means in 
a predetermined size, for selectively operating 
the one or more cameras; 
searching means for searching for an empty 
area on the display means, other than a display 20 
area occupied by the image previously dis- 
played by said display processing means; and 
control means for causing said interface to be 
displayed in the empty area found by said 
searching means. ss 

A camera control system according to claim 6. 
wherein if the empty area found by said searching 
means does not satisfy a predetermined condition, 
said control means relocates the display area oocu- 30 
pied by the image displayed on the display means. 

A camera control system according to claim 6, 
wherein if the empty area found by said searching 
means does not satisfy a predetermined condition, 35 
said control means reduces said interface In scale 
and causes said interface to be displayed on the 
display means on a reduced scale. 

A control method for a camera control system capa- 40 
ble of displaying a picked-up image obtained from 
one or more cameras, on a display screen of a dis- 
play device, comprising: 

a selecting step of selecting a camera of the 45 
one or more cameras; 

a display processing step of displaying an 
image obtained from the camera selected by 
said selecting step, on the display screen in a 
predetermined size; so 
a searching step of searching for an empty 
area on the display screen, other than a display 
area occupied by the image previously dis- 
played by said display processing step; and 
a control step of causing a new image obtained ss 
from the camera to be displayed in the empty 
area found fcyy said searching step, if the new 
image is additionally displayed by said display 
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10. A control method according to daim 9. further com- 
prising an interface displaying step of displaying an 
interface for selectively operating the one or more 
cameras, on the display screen in a predetermined 
size, wherein said searching step searches for an 
empty area on the display screen, other than both 
the display area occupied by the image displayed 
by said display processing step and a display area 
occupied by the internee. 

11. A control method according to claim 9, wherein if 
the empty area found by said searching step does 
not satisfy a predetermined condition, said control 
step relocates the display area occupied by the 
image displayed on the display screen. 

1 2. A control method according to claim 9, further com- 
prising an interface displaying step of displaying an 
interface for selectively operating the one or more 
cameras, on the display screen in a predetermined 
size, wherein if the empty area found by said 
searching step does not satisfy a predetermined 
condition, said control step reduces the interface in 
scale and causes the interface to be displayed on 
the display screen on a reduced scale. 

1 3. A control method according to claim 9, further com- 
prising an interface displaying step of displaying an 
interface for selectively operating the one or more 
cameras, on the display screen in a predetermined 
size, wherein said control step causes the interface 
to be displayed without overlapping a display area 
occupied by an image picked up by a camera con- 
trolled by the interlace. 

14. A control method for a camera control system capa- 
ble of displaying a picked-up image obtained from 
one or more cameras, on a display screen of a dis- 
play device, comprising: 

a selecting step of selecting a camera of the 
one or more cameras; 

a display processing step of displaying an 
image obtained from the camera selected by 
said selecting step, on the display screen in a 
predetermined size; 

an interface displaying step of displaying an 
interface for selectively operating the one or 
more cameras, on the display screen in a pre- 
determined size; 

a searching step of searching for an empty 
area on the display screen, other than a display 
area occupied by the image previously dis- 
played by said display processing step; and 
a control step of causing the interface to be dis- 
played in the empty area found by said search- 
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15. A control method according to claim 14. wherein rf 
the empty area found by said searching step does 
not satisfy a predetermined condition, said control s 
step relocates the display area occupied by the 
image displayed on the display screen. 

16. A control method according to claim 14. wherein if 
the empty area found by said searching step does io 
not satisfy a predetermined condition, said control 
step reduces the interface in scale and causes the 
interface to be displayed on the display screen on a 
reduced scale. 

75 

17. A storage medium which stores a program for exe- 
cuting processing for a camera control system 
capable of displaying a picked-up image obtained 
from one or more cameras, on a display screen of a 
display device, said storage medium allowing the 20 
camera control system to execute the following 
processing: 
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empty area does not satisfy a predeter- 
mined condition. 

20. A storage medium which stores the program for 
executing processing for the camera control sys- 
tem, according to claim 17, further allowing the 
camera control system to execute the following 

processing: 

displaying an interface for selectively operating 
the one or more cameras, on the display 
screen in a predetermined size, and if the 
empty area found does not satisfy a predeter- 
mined condition, reducing the interface in scale 
and causing the interface to be displayed on 
the display screen on a reduced scale. 

21. A storage medium which stores the program for 
executing processing for the camera control sys- 
tem, according to claim 17, further allowing the 
camera control system to execute the following 
processing: 



selecting a camera of the one or more cam- 
eras; 25 
displaying the image obtained from the camera 
selected, on the display screen in a predeter- 
mined size; 

searching for an empty area other than a dis- 
play area occupied by the image previously dis- 30 
played on the display screen; and 
causing a new image obtained from the one or 
more cameras to be displayed in the empty 
area found, if the new image is additionally dis- 
played. 35 

18. A storage medium which stores the program for 
executing processing for the camera control sys- 
tem, according to claim 17, further allowing the 
camera control system to execute the following 40 
processing: 

displaying an interface for selectively operating 
the one or more cameras, on the display 
screen in a predetermined size, and searching 4s 
for an empty area on the display screen, other 
than both the display area occupied by the 
image displayed on the display screen and a 
display area occupied by the interface. 

50 

19. A storage medium which stores the program for 
executing processing for the camera control sys- 
tem, according to claim 17. further allowing the 
camera control system to execute the following 
processing: ss 

relocating the display area occupied by the 
image displayed on the display screen, if the 



displaying an interface for selectively operating 
the one or more cameras, on the display 
screen in a predetermined size, and causing 
the interface to be displayed without overlap- 
ping a display area occupied by an image 
picked up by a camera controlled by the inter- 
face. 

22. A storage medium which stores a program for exe- 
cuting processing for a camera control system 
capable of displaying a picked-up image obtained 
from one or more cameras, on a display screen of a 
display device, said storage medium allowing the 
camera control system to execute the following 
processing: 

selecting a camera of the one or more cam- 
eras; 

displaying the image obtained from the camera 
selected, on the display screen in a predeter- 
mined size; 

displaying an interface for selectively operating 
the one or more cameras, in a predetermined 

size; 

searching for an empty area other than a dis- 
play area occupied by the image displayed on 
the display screen; and 

displaying the interface in the empty area 
found. 

23. A storage medium which stores the program for 
executing processing for the camera control sys- 
tem, according to claim 22, further allowing the 
camera control system to execute the following 
processing: 
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relocating the display arelSBcupied by the 
image displayed on the display screen, if the 
empty area found does not satisfy a predeter- 
mined condition. 

5 

24. A storage medium which stores the program for 

executing processing for the camera control sys- 
tem, according to claim 22, further allowing the 
camera control system to execute the following 
processing: io 



reducing the interface in scale and causing the 
interlace to be displayed on the display screen 
on a reduced scale, If the enpty area found 
does not satisfy a predetermined condition. 75 



20 



25 



30 



35 



40 



45 



50 



55 



10 




11 



EP 0 860 998 A1 



FIG.2 



20 



CPU 



SECONDARY 
STORAGE 



OS 



CAMERA CONTROL 

PROGRAM 



INPUT PART 



DISPLAY 
PART 



.8 



IMAGE 

PROCESSING 
DEVICE 



CAMERA 
l/F 



NETWORK 
l/F 



RAM 



ROM 



12 



CAMERA 



11 



14 



15 



12 




EP 0 860 998 A1 




FIG. 3 



20a 



CONTROL 
TERMINAL 



20b 



CONTROL 
TERMINAL 



13 



20c 



CONTROL 
TERMINAL 



.20d 



CONTROL 
TERMINAL 



13 



EP 0 860 998 A1 




G.4 




14 



EP 0 860 998 A1 



FIG.5 



( START ) 



SELECT PICKED-UP 
IMAGE 



OBTAIN IMAGE DATA 



MAKE SEARCH IN 
AREA LIST 




IS THERE EMPTY 
AREA ? 




NO 





YES 


DISPLAY PICKED-UP 
IMAGE 






ENTER POSITION OF 
PICKED-UP IMAGE IN 
AREA LIST 







r 



SI 05 



RELOCATE 



S106 



UPDATE VALUE OF 
AREA LIST 



( 



END 



) 



15 



EP 0 860 998 A1 




FIG. 6 




16 



^ EP0860998A1 



6 

I— I 
Ph 



CAMERA 
CONTROL 


1 


1 


X 


O 


u. 
O 










COORDINATES 
LOWER RIGHT 
POINT 


640,320 


600,300 


315,235 


315.475 


u. 
O 










COORDINATES 
UPPER LEFT 
POINT 


o 
o' 


400,20 




5,245 


NAME OF AREA 


MAXIMUM AREA 


CONTROL AREA 


TERMINAL #1 


TERMINAL #2 



17 




18 



S201 




EP 0 860 998 A1 



F I G. 9 



S202 ^OBTAIN IMAGE DATa) 



S203- 
S204- 



MAKE SEARCH IN 
AREA LIST 



I 



IS THERE EMPTY 
AREA ? 



NO 



S207-- 



YES 




DISPLAY PICKED-UP 


IMAGE 





S205 



RELOCATE 



S208' 



S209- 



ENTER POSITION OF 
PICKED-UP IMAGE IN 
AREA LIST 



S206 



UPDATE VALUE OF 
AREA LIST 



DOES GUI OVERLAP 
DISPLAY AREA ? 



NO 



YES 



S210- 
S211 



MAKE SEARCH IN 
AREA LIST 



IS THERE EMPTY 
AREA ? 



NO 



YES 



S212' 



S214- 



MOVE GUI INTO 
EMPTY AREA 



S213 



MOVE GUI INTO 
IMAGE DISPLAY ARE/^ 



ENTER NEW DATA IN 
AREA LIST 



c 



END 



3 



19 



EP 0 860 998 A1 



FIG. 10 




20 




21 



EP 0 860 998 A1 



FIG. 12 




22 



EP 0 860 998 A1 




European Patent 
Office 



EUROPEAN SEARCH REPORT 



Application Number 

EP 98 10 3136 



DOCUMENTS CONSIDERED TO BE RELEVANT 



Category 



Citation of document with indicatjon, where appropriate, 
of relevant passages 



Relevant 
to claim 



CLASSIFICATION OF THE 
APPLICATION (lnLCI.6) 



Y 
A 



PATENT ABSTRACTS OF JAPAN 

vol. 095, no. 007, 31 August 1995 

& JP 07 104965 A (OKI ELECTRIC IND CO 

LTD), 21 April 1995, 

* abstract * 



EP 0 644 694 A (CANON KK] 
* the whole document * 



PATENT ABSTRACTS OF JAPAN 

vol. 018, no. 587 (P-1824), 10 November 

1994 

& JP 06 215101 A (RICOH CO LTD), 5 August 
1994, 

* abstract * 

EP 0 645 932 A (AT & T GLOBAL INF 
SOLUTION) 

* the whole document * 



The present search report has been drawn up for all claims 



1,6,9, 
14,17.221 



2-5,7.8, 
10-13, 
15,16, 
18-21, 
23,24 

1,6,9. 
14.17.22 
2-5,7.8. 
10-13. 
15,16. 
18-21. 
23,24 

1-24 



H04N7/18 
H04N7/15 



TECHNICAL RELOS 
SEARCHED (lnLa.6) 



H04N 



1-24 



Place of March 

BERLIN 



Dale of completbn of the search 

14 April 1998 



Examiner 

Greve. M 



CATEGORY OF CfTED OOCUIMEIMTS 

X : particularty relevant if taken alone 

Y : particularty relevant if combined with another 

document of the same category 
A : technological background 
O : non-written (foobsure 
P I intsrmediate dooument 



T : theory or princfite underlying the invention 
E : earlier pe^nt document, but published on, or 

after the filing date 
0 : docunwnt cited in the application 
L : document cited for other reasons 

& : member of the same patent fam'dy, corresponding 
dooument 



23 



